ON THE EXISTENCE OF UNSTABLE BUMPS IN NEURAL NETWORKS 



VADIM KOSTRYKIN AND ANNA OLEYNIK 



Abstract. We study the neuronal field equation, a nonlinear integro-differential equation of 
Hammerstein type. By means of the Amann three fixed point theorem we prove the existence 
of bump solutions to this equation. Using the Krein-Rutman theorem we show their Lyapunov 
instability. 



1. Introduction and Main Results 

The behavior of a single layer of neurons can be modeled by a nonlinear integro-differential 
equation of the Hammerstein type, 

(1.1) dtu{x,t) = -u{x,t) + uj{x - y)f{u{y,t) - h)dy. 

Here u{x, t) and f{u{x, t)—h) represent the averaged local activity and the firing rate of neurons 
at the position x G M and time t > 0, respectively. The parameter /i > is a firing threshold, 
and uj{x — y) describes a coupling between neurons at positions x and y. 

The model described above has been studied in numerous mathematical papers (for review 
see, e.g., [2], [5]). In particular, the global existence and uniqueness of solutions to the initial 
value problem for equation (1.1) under rather mild assumptions on / and w has been proven in 
[9]. 

In 1977, Amari studied pattern formation in (1.1) for a model where / is the Heaviside 
function and lo is assumed to be continuous, integrable and even, with a;(0) > and having 
exactly one positive zero. In particular, he showed the existence of stable and unstable bumps, 
that is, time independent spatially localized solutions to (1.1). For more general / and uj the 
existence of stable solutions of this kind has been shown by Kishimoto and Amari in [7] and 
later generalized by Oleynik, Ponosov, and Wyller in [8]. In the present work we prove the 
existence of unstable bumps. 

Our main assumptions are as follows. 

Assumption A. Let / : M — > [0, 1] be an arbitrary continuous nondecreasing function such 
that f{x) = Ofor all x <0 and f{x) = Ifor all x > t with r > 0. 

Assumption B. We assume that the integral kernel u meets the following conditions: 

(i) J^oo \^{^)\dx < oo, that is, lo G L-'-(M), 

(ii) UJ is bounded and continuous, 

(iii) UJ is a symmetric function, i.e., uj{—x) = uj{x), 

(iv) there is an a > such that uj{x) > Ofor almost all x G [0, 2a], 

(v) for given h,T > 

r-2a 

/ ^{y)dy > h + T. 
Jo 
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Hence, there are < A_ < A-|_ < a such that 

/ w(A_ - y)dy = h, / a;(A+ - y)dy = h + r. 
V-A_ J-A+ 

For all X eM. we define 

(1.2) u±{x) := oj{x-y)dy. 

J-A± 

(vi) there is a d El (A_j_, a] such that u^{d) = h, 

(vii) u is decreasing on [0, 2d\ and u{x) < Lo{2d) for all x > 2d. 

For example, the function u(x) = exp(— x^) satisfies Assumption B. 

The condition (ii) of Assumption B implies that u± are continuous, whereas from the condi- 
tions (iii) and (iv) the inequality U-{x) < u+{x) for all x G [—d, d] follows. 

Lemma 1.1. Condition (vii) in Assumption B is fulfilled if and only if 

(1.3) uj{x — y) < uj{d — y) for all x>d and yE[—d,d]. 

Proof. Assume that the condition (1.3) is fulfilled. We introduce ^ = d — y. Then we have 

(1.4) oj{^ + {x-d))<oj{0, ^e[0,2d]. 

Since x — d > the inequality (1.4) implies the monotonicity of oo on [0, 2d]. Next, we set 
^ = 2din (1.4), thus, obtaining 

uj{r]) < uj{2d) with r] = x + d > 2d. 

Conversely, assume that condition (vii) is satisfied. Let x > d and y G [0, 2d] be arbitrary. If 
X — y E [0, 2d], then the inequality u{x — y) < oj{d — y) follows from the monotonicity of uj 
and X — y > d — y.\i X — y > dv^Q then obtain 

oj{x — y) < oj{2d) < oj{d — y). 

n 

Under Assumption B it is easy to show that the functions u+ and u_ solve equation (1.1) with 
/ the chracteristic function of (r, oo) and (0, oo), respectively. The proof is given in Appendix, 
see Lemma A. 1 . 

Following Amari [1] we call a stationary solution of equation (1.1) a bump (more precisely, 
1-bump) if the support of the function x i-> f{u{x) — h) is an interval. According to this 
definition u± are bumps, see Lemma A. 1 in Appendix. 

Our main results are as follows: 

Theorem 1. Under Assumptions A and B there exists a bump solution u to the integro- differen- 
tial equation (1.1), that is, a stationary solution with supp/(S(-) — h) an interval. Moreover, 

(1.5) u-{x) < u{x) < u+{x) 

holds for all x G [—d, d] and, hence, the support of f{u{-) — h) is contained in [—d, d]. 

Theorem 2. Assume in addition to Assumptions A and B that 

(i) u G W^'°°{'R), the Sobolev space of almost everywhere differentiable functions with 

essentially bounded derivative, 

(ii) uj{x) — > a5 oo, 

(iii) / G C^''*(M), that is, f is continuously differentiable and its derivative is Holder con- 
tinuous with an exponent p, G (0, 1], \f'{x) — f'{y)\ < C\x — y\^. 
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Then the solution u referred to in Theorem 1 belongs to Coo(lR)- It is an Lyapunov-unstable 
equilibrium of the integro-differential equation (1.1), that is, for all sufficiently small £ > 
there is an initial value in the ball Bf. (u) C Cqo (K) such that the corresponding solution to 
(1.1) leaves Bs{u) in finite time. 

Here Coo(M) denotes the Banach space of continuous functions vanishing at infinity. 
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2. Proof of Theorem 1 

In this section we treat u± defined in (1.2) as functions on [—d, d]. We define a nonUnear 
integral operator 

(2.1) (Tn)(x) := T io{x - y)f{u{y) - h)dy 



and consider the fixed point problem 

u = Tu 

in the real Banach space C{[—d, d]). The cone 

(2.2) K:={ue C{[-d, d\) : u{x) > for all x € [-d, d]} 

defines a partial order in C{[—d, d]). We write u>v if u — v&K,u>v if u>v and u ^ v, 
and n ^ if u — u is in interior of K. 

Lemma 2.1. Under Assumptions A andB the operator T : C{[—d, d]) C{[—d, d]) is mono- 
tone increasing and image compact. Moreover, Tu- <C n_ and Tu^ ^ m+. 

Recall that an operator T acting on the ordered Banach space X is called monotone increasing 
ifu<v impUes Tu < Tv. The operator T is called image compact if it is continuous and its 
image TX is relatively compact in X. 



Proof. The linear integral operator 



i-> / uj{- - y)u{y)dy 



is continuous and compact as a mapping in C{[—d,d]). Since the integral kernel ijj{x — y) 
is positive for all x, y G [—d,d\, it is monotone increasing. The mapping u ^ f{u — h) 
is continuous, monotone increasing, and bounded. This implies that T is image compact and 
monotone increasing. Since f{t) < X(o,oo)(*) on a set of positive measure, we obtain 

/d I'd 
uj{x-y)f{u-{y)-h)dy< / u{x - y)x(o,oo){u-{y) - h)dy 
-d J —d 

= I - y)dy = U-{x), 

J-A- 
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which proves the first inequahty. Similarly, the inequaUty f{t) > X{T,oo){'t) holds on a set of 
positive measure. Therefore, 

/d pd 
i^ix - y)f{u+{y) - h)dy > uj{x - y)x[T,oo){u+{y) - h)dy 
'd J —d 

= / ui{x-y)dy = u+{x), 
J~A+ 

which proves the second inequaUty. □ 

For any u in the order interval [«_, := {u G C{[—d, d]) : U- <u < we define the 
mapping 

(2.3) (T'n)(x) := m£Lx{min{(r'u)(a;),u-|-(a;)},'u_(x)} , x&[—d,d\, 

or, more explicitly, 

u^{x) if {Tu){x) < ti-(x), 
{Tu){x) = I {Tu){x) if u-{x) < {Tu){x) < u+{x), 
u+{x) if < {Tu){x). 

Since the r.h.s. in this definition is a continuous function satisfying 

u-{x) < m.8i:K{m.m{{Tu){x),u+{x)},u-{x)} < u+{x) 
for all X e [—d,d],T is a self-mapping of [u- , u+]. Furthermore, u± are fixed points, 

Tu-t- = u±. 

Lemma 2.2. The operator T is monotone increasing and image compact. Moreover, for suffi- 
ciently small £ > one has 

f{u- + e) < u_ + e < w+ - e 

and 

T{u+ — e) ^ u+ — £ ^ u- + £. 
Proof. By the monotonicity of the operator T one has Tui > Tu2 whenever ui > U2. Hence, 

min{(riii)(x), > min{(rii2)(x), for all x^[—d,d], 

and, therefore, 

max{min{(Tni)(a;),u+(x)},«_(a;)} > max {min{(T?X2)(a;), . 

Thus, T is monotone increasing. 

Let [un) be an arbitrary sequence in Since T is image compact, {Tun) has a 

subsequence (Tun^.) converging to some v G C{[—d,d]). For arbitrary £ > let no G N be so 
large that 

\Tun^.{x) — v{x)\ < £ for all k > hq and x G [—d,d]. 

Then one has 

mm{Tun^{x),u^{x)} < min{t;(x) + e, < mm{v{x),u+{x)} + £ 

and 

mm{Tun^{x) , u+{x)} > min{v{x) — £,U-^-{x)} > m.in{v{x),u^{x)} — e, 
which shows that min{T?i„j, (x), converges uniformly to min{w(x), u+(x)}. Similarly, 

one can show that {Tun^.) converges uniformly to max {m.m{v{x),u+ (x)}, u-{x)}, thus, prov- 
ing that the range of T is relatively compact. 
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Now assuming that the sequence (?x„) converges to some u G [«_, it+] and using the con- 
tinuity of T, we arrive at the conclusion that (T«„) converges to {Tu), thus, proving that T is 
continuous. 

Since the mapping u G C{[—d,d]) h-)- infj.g[_^^ u(a:;) is continuous, the functional p : 
C([-d,d])^M, 

p{u) := inf {u{x) - {Tu){x)) 

is continuous as well. Hence, due to p{u-) > 0, there is an e > such that p{u) > for all 
u € B2e{u-.). We can choose £ so small that u- + e <^uj^ — e. Thus, 

r(u_ + £) < u_ + e < u+ - e, 

from which it follows that 

min{T(M_ + e), «+} = T{u- + e) 

and consequently 

r(n- + e) = max{r('u_ + e), «_} ^ u_ + e. 
The second inequahty can be proven in the same way. □ 

The main tool for the proof of Theorem 1 is Amann's theorem on three fixed points (see, e.g., 
[10, Theorem 7.F and Corollary 7.40]): 

Theorem 2.3. Let X be a real Banach space with an order cone having a nonempty interior 
Assume there are four points in X 

Pi < P2 < P3 < P4 
and a monotone increasing image compact operator T : \pi,p^ ^ X such that 

fpi = pi, fp2 < P2, Tp3 > P3, fp4 = P4. 

Then T has a third fixed point p satisfying p\ < p < p^, p ^ [pi , P2], and p ^ [ps, ^4]- 

We choose pi = n_, p2 = + P3 = — e, p4 = u^, where e > as in Lemma 2.2. 
Theorem 2.3 yields the existence of a fixed point of operator T satisfying u- < < u^. 
Obviously, is a fixed point of the operator T defined in (2.1) as well. 

Lemma 2.4. If a fixed point u of the operator T satisfies the inequality u{d) < u+{d) = h, 
then 

u{x) = / Lv{x - y)f{u{y) - h)dy, a; G M. 
J-d 

is a bump which solves (1.1). 

Proof. Due to condition (vii) of Assumption B and Lemma 1.1, we have oj{x — y) <oo{d — y) 
for all X > d. Hence, u{x) < u{d) < h. This imphes that u{x) solves the equation 

/oo 
^{x - y)f{u{y) - h)dy, X eR. 
■00 

□ 

Remark 2.5. We note that u is not an isolated solution of (2.4). Indeed, u{- — c) is again a 
solution for any c G M. 
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3. Proof of Theorem 2 

The proof of Theorem 2 heavily relies on the Krein-Rutman theorem (see, e.g., [10, Proposi- 
tion 7.26]): 

Theorem 3.1. Let X be a real Banach space with the order cone K having a nonempty interior 
Suppose that T : X ^ X is linear, compact, and positive, with the spectral radius r{T) > 0. 
Then r{T) is an eigenvalue ofT with all eigenvectors in K. 

The second tool is a classical result on the instability of equilibrium solutions of differential 
equations [3, Theorem Vn.2.3] {cf. also Corollary 5.1.6 in [6]). 

Theorem 3.2. Let X be a Banach space, Abe a linear continuous operator on X, F : X X 
a nonlinear Lipschitz continuous operator If 

(i) vq = satisfies Avq + Fvq = 0, 

(ii) the operator F obeys the estimate 

(3.1) \\Fv\\ <C\\v\\^+^', C>0, n>0 

for all u ^ X with \\v\\ < efor some e > 0, 

(iii) the spectrum a {A) contains a point A with Re A > 0, 

then vq is an unstable equilibrium of the differential equation 

v^ = Av + Fv, t > 0. 

Let tt* G C{[—d, d]) denote the fixed point of the operator T (2.1) referred to in the previous 
section. From the condition (i) of Theorem 2 it follows that u^, belongs to C^{[—d, d]). For the 
proof see Lemma A.2 in Appendix. Due to (1.5), one has u*(— d) < h, ^^(O) > u_(0) > h, 
and (d) < h. Thus, is not monotone. 

We observe that under the conditions of Theorem 2 the operator T is Frechet differentiable 
with 

.d 

{T'{u)v){x) = uj{x- y)f'{u{y) - h)v{y)dy, v G d]). 
J-d 

It is a linear, compact, and positive operator with respect to the cone defined by (2.2). 
Since «*(±ci) < h, integrating by parts we obtain 

rd f-d Q 

u'*{x)=j uj'{x-y)f{u*{y)-h)dy = - —u;{x-y)f{u^{y)-h)dy 

J-d J-d 

= / ^^{x - y)f'{u^{y) - h)u^{y)dy. 
J-d 

Hence, u'^ is an eigenfunction of the operator T'{u*) with eigenvalue 1. Thus, the spectral radius 

r{T'{u^)) is not smaller than 1. 

Assume that r(T'{u^)) = 1. Applying the Krein-Rutman theorem with X = C {[—d, d]), the 
cone K defined in (2.2), and the operator T'{u^), we obtain that u'^{x) > for all x G [— d, d], 
which is a contradiction. Thus, r{T'{u*)) > 1. Again by the Krein-Rutman theorem r{T'{u^,)) 
is an eigenvalue of T'{u^). Hence, we arrive at the conclusion that the Frechet derivative of 
u I-)- —u + Tu at the point has a strictly positive eigenvalue. 

Denote by T the nonhnear integral operator defined via 



iTu){x) := / u;{x - y)f{u{y) - h)dy. 
Jr 



Observe that under the condition (ii) of Theorem 2, T maps Coo (1^) into itself. Hence, the bump 
u referred to in Theorem 1 belongs to 
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Lemma 3.3. Let the conditions of Theorem 2 be satisfied. Then the Frechet derivative T'{u) : 
Coo(M) Coo(M) of the operator T, 

(t'{u)v) (x) = f u{x- y)f{u{y) - h)v{y)dy, 

is compact. 

Proof. The proof is based on the following compactness criterion [4, Theorem IV.6.5]: 

• A bounded subset S C C (M) is relatively compact if and only if for every e > there 
is a finite collection of sets Ei C M., i = 1, . . . ,n, IJILi ~ points Xj G Ei 

such that 

sup sup \<f{Xi) — ip{x)\ < £ 

for alH = 1, . . . ,n. 
Consider a set 

S:={^e C7oo(M) : <f = f'{u)v, v G Bi{0) C Coo(M)}. 
Using the mean value theorem we obtain 

|^(x)| < r \u{x-y)\f{u{y)-h)dy 

J-d 

< \uj{x - r/)| • f'{u{r]) - h) 

for some ?7 G [—d, d] and any ip e S. Hence, 

\(p{x)\ < C sup \uj{x — y)\ 
ye[-d,d\ 

for all ip e S. Therefore, by the condition (ii) of Theorem 2, for an arbitrary e > we can 
choose R> dso large that 



sup|</5(a;)| < e/2 for all |x| > R. 



Thus, we obtain 



(3.2) sup sup \(p{x) - f{±2R)\ < e, 

<peSxeE± 

where E± := {x eR \ ±x > ±R}. 

Let be the set in C{[—R,R]) consisting of all functions in S restricted to the interval 
[-R,R], 

So ■= {ipo = 'p\[-R,R] : ipeS}. 
This set is the range of the compact integral operator 



J-R 



y)f'{u{y) - h)v{y)dy, 



mapping C{[—R, R]) into itself. Thus, 5*0 is relative compact. 

By the compactness criterion above, there is a finite collection (Ei)"^-^ of subsets in [—R, R] 
and points Xi G Ei such that 

sup sup \ip{Xi) — ip{x)\ < £ 

for all i = 1, . . . , n. Combining this with (3.2), we arrive at the conclusion that the collection 
(£^1, . . . , En, E^,E-) with points (xi, . . . , Xn, 2R, —2R) satisfies the condition of the com- 
pactness criterion, thus, proving that S is a relative compact set. Hence, T'{u) is a compact 
operator. □ 
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Now we show that the Unear operators T'{u) and T'{u^) have the same spectra. Since both 
operators are compact, it suffices to prove that they have the same eigenvalues. Assume that 
A 7^ is an eigenvalue of T'{u^) with an eigenfunction v G C([— d, d\). We set 



v{x) '-jj y)f'{u^{y) - h)v{y)dy, 



X G 



It is easy to check that ^J is an eigenfunction of T'{u) corresponding to the eigenvalue A. Con- 
versely, assume that v 6 Coo(I^) is an eigenfunction of T'{u) corresponding to the eigenvalue 
A 7^ 0. Then 

A?;(a;) = / u{x - y)f {u{y) - h)v{y)dy = / uj{x - y)f'{u^{y) - h)v{y)dy 

holds for all x G [—d, d]. This implies that A is an eigenvalue of T'{u^,) with an eigenfunction 

We arrive at the conclusion that the linear operator T'{u) has an eigenvalue A > 1, and, thus, 
the condition (iii) of Theorem 3.2 is fulfilled. 

Plugging u{x, t) = u{x) + w{x, t) into the equation ut = —u + Tu we obtain 

Wf = Aw + Fw, 

where 

Av = -v + f'{u)v and Fv = f{u + v) - fu - f' {u)v 
for any v G Coo(K). 

From the continuous differentiability of / it easily follows that T is Lipschitz continuous. By 
the mean value theorem one has 

f{u + v){x) - {fu){x) = / uj{x - y) {f{u{y) + v{y) - h) - f{u{y) - h)) dy 

JR 

^{x - y)f'{a{y) - h)v{y)dy, 

where a{y) is a point between u{y) and u{y) + v{y), y G M. Hence, 
f{u + v){x) - {fu){x) - {f'{u)v){x) 
= [ co{x- y) {f{a{y) - h) - f{u{y) - h)) v{y)dy. 

From the Holder continuity of /' it follows that 

\f\aiy) -h)- f'iuiy) - h)\ < C\a{y) - S(j/)r < C|t;(j/)r. 

Thus, 

\f(u + v){x) - {fu){x) - {f'{u)v){x)\ <C [ \u;{x-y)\\viy)\^+^'dy 

Jr 

< Cll^llJ^ni^llLMR), 

which implies that the condition (ii) of Theorem 3.2 is fulfilled. Consequently, by Theorem 3.2 
with X = Coo(K), u is an unstable equilibrium of the equation 

(3.3) ut = -u + fu. 

This completes the proof of Theorem 2. 



/ 
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Appendix 

Lemma A.l. Under Assumption B the function given by (1.2) is a stationary solution of 
(1.1) with f = X(o,oo)- Similarly, u+ is a solution of (1.1) with f = X(t,oo)- particular, 

suppX(o,oo)(^^-(-) -h) = [-A_, A_] and suppx{T,oo){u+{-) - h) = [-A+,A+]. 

Proof. To prove that U- solves (1.1) with / = X(o,oo) it suffices to show that 

u-{x)>h for all a;G[0,A_] 

and 

u-{x) < h for all x G (A_,oo). 
If X G [0, A_] we represent u- as follows 

U-{x) = I uj{z)dz 
Jx-A- 

/■2A- /■2A- /-O 

= / u{z)dz — I uj{z)dz + / uj{z)dz. 
Jo Jx+A- Jx-A- 

Observe that the first integral equals h. Using the symmetry of (jj{z) we, thus, obtain 

fA^ —X 

u-{x) = h+l {ijj{z) - ijj{z + X + A._))dz > h 
Jo 

by the condition (vii) of Assumption B. 
If X > A_ we represent u_ as 



u-ix) = / uj{x~y)dy+ / u{x-y)dy, 
Jh Jh 

where 

h := {y G [-A_, A_] : 0<x-y<2d} 

and 

h := {yG [-A_,A_] ■.2d<x-y}. 

For any y G /i we have u}(x ~y) < c<j(A_ — y) since w is decreasing on [0, 2d] by the condition 
(vii) of Assumption B. If y G h, then again by condition (vii) of Assumption B we obtain the 
inequality 

Lo{x -y) < oj{2d) < a;(A_ - y). 
Hence, in both cases the inequaUty 



u. 



.{x)< [ uj{A_-y)dy = h 
J-A. 



is vaUd. 

That u+ is a solution to (1.1) with / = X{t,oo) can be proved in the same way. □ 

Lemma A.2. If the integral kernel u satisfies Assumption B and the condition (i) of Theorem 2, 
then the stationary solution u referred to in Theorem 1 is continuously differentiable. 

Proof. From (2.4) it follows that the derivative u'{x) exists for each a; G M and is given by 

u'{x)= / u'{x -y)f{u{y) -h)dy = / uj'{y)f{u{x - y) - h)dy. 
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Hence, since 11^' II irOO (IK^) < oo, for any d > Owe have 

\u'{x + S)-u'{x)\< [ \uj'iy)\\f{u{x + d-y)-h)-f{u{x-y)-h)\dy 

JR 

< ||'^'||l°°(r) / + S-y)-h)- f{u{x -y)- h)\dy 

JR 

= ||w'||ioo(K)||/(S(- + S)-h)- /(n(-) - /i)IIli(m). 

By the continuity of translations in L^(M) we obtain that \u'{x + S) —u'{x)\ as S 0, 
thus, proving that u' G C(M). □ 
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